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Abstract 

Heap monoids equipped with Bernoulli measures are a model of probabilis¬ 
tic asynchronous systems. We introduce in this framework the notion of asyn¬ 
chronous stopping time, which is analogous to the notion of stopping time for 
classical probabilistic processes. A Strong Bernoulli property is proved. A 
notion of cut-invariance is formulated for convergent ergodic means. Then a 
version of the Strong law of large numbers is proved for heap monoids with 
Bernoulli measures. Finally, we study a sub-additive version of the Law of large 
numbers in this framework based on Kingman sub-additive Ergodic Theorem. 

1—Introduction 

Heaps of pieces are combinatorial structures that appear in several domains of Com¬ 
binatorics and Computer science. They were first studied under the algebraic pre¬ 
sentation of free partially commutative monoids [4], also called trace monoids. The 
visual presentation as heaps of pieces was introduced by Viennot [21]. Their applica¬ 
tion to computation models relies on their ability to model in an intrinsic way the 
asynchrony of actions, that is to say, the fact that different actions depending on 
disjoint resources may occur concurrently [8, 9]. 

Several probabilistic models attached to heaps have been studied. A study initi¬ 
ated by Vershik [20, 13] concerns the limit behavior of random walks defined on heaps 
of pieces, when the size of the heap monoid increases. In an other approach [16, 12, 
2], authors consider various families of finite uniform probability distributions: on 
heaps of size n and on heaps of height n. 

In this paper, we adopt a different point of view, and consider Bernoulli measures 
on the boundary at infinity of the heap monoid. The elements of the boundary at 
infinity identify with infinite heaps. The existence of Bernoulli measures for heap 
monoids was proved in a joint work by the author and J. Mairesse [1]. Bernoulli mea¬ 
sures have the property of being multiplicative with respect to the monoid structure 
of the heap monoid, and they enjoy several properties related to the combinatorial 
structure of heap monoids. In particular, elements of a heap monoid are know to have 
a canonical normal form, called the Cartier-Foata decomposition. Under a Bernoulli 
measure, the random elements that successively occur in the decomposition form a 
Markov chain, of which both the initial distribution and the transition matrix have 
specific expressions, formulated through the combinatorial tool of the Mobius trans¬ 
form. 
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This paper introduces a formalism in order to express a Law of large numbers for 
heap monoids under Bernoulli measures. A central difficulty with heap monoids 
is that a given heap has several presentations as a succession of pieces piled up 
one upon another. Different presentations of the same heap differ in the order of 
occurrences of certain pieces. The same issue occurs of course with infinite heaps. 
Consequently, there is no natural identification between a given infinite heap, and 
an infinite sequence of pieces. Nevertheless, if (^ : E —>■ R is a real valued function 
defined on the set of basic pieces, we wish to obtain asymptotic estimates for ergodic 
sums of the form Sn4> = + •. • + where (ai, 02 ,...) is one presentation of 

a typical infinite heap 

For this purpose, we introduce a notion of cut for infinite heaps. Cuts are shown 
to share several properties with classical stopping times, hence we actually call them 
asynchronous stopping times (AST). An AST allows to select from any given infinite 
heap a sub-heap of The analogy with standard stopping times is this one: for 
instance the first hitting time T of a given state a of a Markov chain takes an infinite 
path oj = {xi,X 2 ,...) as input, and returns an integer T{uj). All the properties of 
the stopping time T can be interpreted when considering instead of the integer T{uj), 
the sub-path (xi,..., Xt{uj))- Hence a stopping time can be seen as a particular kind 
of mapping from infinite paths to paths. Similarly, an AST is a particular kind of 
mapping from infinite heaps to heaps. 

Asynchronous stopping times can be iterated, just as usual stopping times can 
be iterated. If V is an AST, we define the associated sequence of iterated stopping 
times (Vn)n>i by recursively piling up C-shaped heaps. The associated ergodic sums 
are then defined by Sv,n4> = , extending the action of </> from pieces to heaps by 

additivity. Let 1 be the constant function equal to 1 on every piece. By additivity, 
IV is the number of pieces within heap V. Then we show that, for every function (j), 
the ergodic means: 

^ ( 1 ) 

have almost surely a limit when n goes to infinity; and that this limit does not depend 
on V . Furthermore, the limit can be computed by using the stationary measure of 
the Markov chain given by the elements of the Cartier-Foata decomposition. 

Consider the case where the function ^ is the characteristic function of a certain 
piece, hence gives value 1 to that piece and 0 to all other pieces. Then the limit of the 
ergodic means (1) appears as the asymptotic density in large heaps of the selected 
piece. The invariance with respect to the AST V means that, whatever cut shape V 
we choose, when one measures the density of presence of a given piece within sub¬ 
heaps recursively obtained by adding “D-shaped” heaps, the resulting asymptotic 
density is always the same. This constitutes the cut-invariant Law of large numbers. 

We also give a sub-additive variant of the Law of large numbers for random heaps. 
It is motivated by the existence of an interesting sub-additive function on heaps, 
namely their height. 

We have included a preliminary section which illustrates most of the notions on a 
very simple case, allowing to do all the calculations by hand. In particular, the cut- 
invariance is demonstrated by performing simple computations using only geometric 
laws. Later in the paper, all the specific computations for this example will be re¬ 
interpreted under the light of Bernoulli measures on heap monoids. 

The paper is organized as follows. Section 2 is the preliminary example section, 
which relies on no theoretical material at all. Section 3 introduces the background on 
heap monoids and Bernoulli measures. Section 4 introduces asynchronous stopping 
times for heap monoids. Section 5 introduces the iteration of asynchronous stopping 
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times. Section 6 states and proves the cut-invariant Law of large numbers. Section 7 
is devoted to the sub-additive variant of the Law of large numbers. 

2—Cut-Invariance on an Example 

The purpose of this preliminary section is twofold. First it will help motivating the 
model of Bernoulli measures on trace monoids, which will appear as a natural prob¬ 
abilistic model for systems involving asynchronous actions. Second, it will illustrate 
that asymptotic quantities relative to the model may be computed according to dif¬ 
ferent presentations, corresponding to different cut shapes of random heaps. The 
interesting point is that, whatever choice is made for the shape of cuts, the associ¬ 
ated asymptotic quantities are invariant. The rest of the paper develops theoretical 
results explaining this invariance, which we merely observe on a simple example in 
this section. 

Consider two communicating devices A and B. Device A may perform some 
actions on its own. These actions will be called type a actions. Similarly, device B 
may perform actions of type b on its own. Finally, both devices may perform together 
a synchronizing action of type c, involving communication on both sides—a sort of 
check-hand action. 

Consider the following simple probabilistic protocol, involving two hxed proba¬ 
bilistic parameters A, A' G (0,1). 

1. Device A and device B perform actions of type a and b respectively, in an 
asynchronous and probabilistically independent way. The number Na of occur¬ 
rences of type a actions and the number TVf, of occurrences of type b actions 
follow geometric laws with parameters A and X' respectively. Hence: 

Vfc, k'>0 P(iVa = k, Nb = k') = A(1 - A)'= • A'(l - X'f . (2) 

2. Then devices A and B perform a synchronizing action of type c, acknowledging 
that they have completed their local actions. 

3. Go to 1. 

We say that Steps 1-2 form a round of the protocol. The successive geometric 
variables that will occur when executing several rounds of the protocol are assumed 
to be independent. 

The question that will guide us throughout this study is the following: what are 
the asymptotic densities of actions of type a, b and c? Hence, we are looking for 
non-negative quantities 'ya,'Jb,'yc such that 7 a + 7 h + 7 c = Ij and that represent the 
average ratio of each type of action among all three possible types. We shall see that 
there are various possible definitions for the density vector 7 = ( 7 a jb 7 c), and 
we will observe by performing the different computations, that all definitions lead to 
the same result. The core of the paper will provide a general framework in which the 
notion of cut-invariance gives a deep explanation for the equality of the results. The 
above protocol is the simplest possible example of this kind. 

Before we suggest possible definitions for the asymptotic density vector, it is cus¬ 
tomary to interpret the executions of the above protocol with a heap of pieces model. 
For this, associate dominoes to each type of action a, b and c. The occurrence of 
an action corresponds to a domino of the associated type falling from top to bottom 
until it either reaches the ground or a previously piled domino. Asynchrony of types 
a and b actions is rendered by letting dominoes of type a and b falling according to 
parallel, separated lanes; whereas dominoes of type c are blocking for dominoes of 
types a and b, which renders the synchronization role of type c actions. A typical 
first round of the protocol, in the heap model, corresponds to a heap as depicted in 
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Round 3 


Round 2 


Round 1 


ib) 


Figure 1: Heaps of pieces corresponding to the execution of: (a) the first round of 
the protocol, (b) the three first rounds of the protocol. 


Figure l~(a) for Na = I and Ni, = 2. The execution of several rounds of the protocol 
makes the heap growing up, as depicted in Figure l-( 6 ). 

Letting the protocol execute without limit of time yields random infinite heaps. 
Let P denote the probability measure that equips the canonical space associated to 
the execution of infinitely many rounds of the protocol. The measure P can also be 
seen as the law of the infinite heap resulting from the execution of the protocol. 

It is important to observe that the law P cannot be reached by the execution of 
any Markov chain with three states a, b, c (proof left to the reader for this particular 
example; or to be deduced from the results of § 3.8). In particular, the estimation of 
the asymptotic quantities that we perform below do not result from a straightforward 
translation into a Markov chain model. 

If N denotes the total number of pieces at Round 1 of the protocol, one has: 


N — Na + Nh + Nc , 


with Nc = 1. 


Each round of the protocol corresponding to a fresh pair {Na, Nb), it is natural to 
define the asymptotic density vector 7 as: 

ENa _ EiVh _ ENa 1 

“ EiV ’ “ EiV ’ “ EfV “ EiV ’ ^ 

where E denotes the expectation with respect to probability P. 

Since Na and N}, follow geometric laws on the one hand, and since EA^ = I + 
ENa + ENb on the other hand, the computation of 7 = ( 7 a 7 h 7c) is immediate 
and yields: 


A'(l-A) _ A(I-A') 

A + A' - AA' ’ “ A + A' - AA' ’ 


AA' 

A + A' - AA' ■ 


( 4 ) 


The description we have given of the protocol has naturally lead us to the defi¬ 
nition (3) for the density vector 7 . However, abstracting from the description of the 
protocol and focusing on the heap model only, we realize that dominoes c play a par¬ 
ticular role, which corresponds to an asymmetry between the three types of actions. 
The special role of c lies in the following: at each round, the formed pile ends up 
with a type c domino. Hence, the specific formulation of the protocol that we have 
adopted above can be rephrased as follows: 

1. Consider the probability distribution P over random heaps. 
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Round' 4 


Figure 2: Cutting heaps relatively to type a dominoes. 


2. Recursively cut an infinite random heap, say ^ distributed according to P, by 
selecting the successive occurrences of type c dominoes in and cutting apart 
the associated sub-heaps, as in Figure 

In this new formulation, point 1 is now intrinsic; while only point 2 relies on a 
special cut shape. Henceforth, the following questions are natural: if we change the 
cut shape in point 2 , and if we compute the new associated densities of pieces, say 
Y = (Y 7b 7c) I is if fr'^s fiis-f 7 = 7^? i® there a more symmetric model to 
describe random heaps, that would not give a special role to any type of domino, and 
that could also provide a way for computing densities? 

Before we enter the core of the topic in the next sections of the paper, we shall 
merely conclude this introductory section by defining and computing indeed an al¬ 
ternative density vector 7 ', and obtain by simple computation the equality 7 = 7 '. 

We consider the variant where heaps are cut at “first occurrence” of type a domi¬ 
noes. We illustrate in Figure 2 the successive new rounds, corresponding to the same 
heap that we already depicted in Figure 1. Observe that each new round involves a 
finite but unbounded number of rounds of the original protocol. 

Let V denote the random heap obtained by cutting an infinite heap at the first 
occurrence of a domino of type a , which is defined with P-probability 1. Denote by 
\V'\ the number of pieces in V'. Denote also by \V'\a the number of occurrences of 
piece a in R', and so on for \V'\b and for \V'\c , so that \V'\ = \V'\a + \V'\b -f |R'|c 
holds. By construction, \V'\a = 1 holds P-almost surely. We define the new density 
vector Y = {la I'b I'c) by: 

EIR'U 1 nv'\b E|R'|c 

E|R'| E|R'| ’ E|R'| ’ E|R'| ' 

The computation of 7 ' is easy. A typical random heap V ends up with a, after 
having crossed, say, k occurrences of c. Immediately before the occurrence of c, 
for j < fc, there has been an arbitrary number, say Ij , of occurrences of b. Hence: 
V' = ■ c - ... ■b^*‘ ■ c - a, with /c > 0 and h,... ,lk ^ 0- Referring to the definition of 

the probability P, one has: 

Vfc, li,..., Zfc > 0, P(R' = • c •... • 6*'= • c • a) = A'=(1 - A)A"=(1 - . 

Since \V'\b = li+.. .-\-lk and \V'\c = k, the computation of the various expectations 
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is straightforward; 

E|l/'|b = 


E|F'|,= 


]E|y'| = 

We obtain the density vector 7 ': 

A'(l-A) A(l-A') AA' 

“ A + A' - AA' ’ “ A + A' - AA' ’ “ A + A' - AA' ' 

Comparing with (4), we observe the announced equality 7 = 7 '. 

3—Heap Monoids and Bernoulli Measures 

In this section, we collect the needed material on heap monoids and on associ¬ 
ated Bernoulli measures. Classical references on heap monoids are [4, 21, 8 , 9]. For 
Bernoulli measures, we refer to the original paper [1]. 

3.1 — Independence Pairs. Heap Monoids 

Let S be a hnite, non empty set of cardinality > 1. Elements of E are called pieces. 
We say that the pair (E, I) is an independence pair if / is a symmetric and irreflexive 
relation on E, called independence relation. We will furthermore always assume that 
the following irreducibility assumption is in force: the associated dependence relation 
D on E, defined by = (E x E) \ /, makes the graph (E, D) connected. 

The free monoid generated by E is denoted by E* , it consists of all E-words. The 
congruence I is defined as the smallest congruence on E* that contains all pairs of 
the form (a 6 , ba) for (a, b) ranging over I. The heap monoid M = Ad(E, I) is dehned 
as the quotient monoid Ai = Yf jX. Hence M. is the presented monoid: 

M = {Y \ ab = ba, for (a, b) G I). 

Elements of a heap monoid are called heaps. In the literature, heaps are also called 
traces; heap monoids are also called free partially commutative monoids. 

We denote by the dot the concatenation of heaps, and by 0 the empty heap. 
A graphical interpretation of heaps is obtained by letting pieces fall as dominoes 
on a ground, in such a way that ( 1 ) dominoes corresponding to different occurrences 
of the same piece follow the same lane; and ( 2 ) two dominoes corresponding to pieces 
a and b are blocking with respect to each other if and only if (a, b) ^ I. This is 
illustrated in Eigure 3 for the heap monoid on three generators T = (a, b, c \ ab = ba). 
This will be our running example throughout the paper. 


^ {I 1 + ... + lk)X’"{l - A)A"=(1 - 

(1 - A)^(AA')"fc ^ h{i - (^(1 - yy)""' 

A:>0 /i>0 />0 

A(l-A') 

A'(l-A) ■ 

Y, fcA'=(l-A)A"=(1- 

(l-A)^A:(AAr(E(l-^')0 ' 

fc>0 l>0 

X 

1 - A ■ 

1 + E|W|f, + EIE'I, = 
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a 

b 
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a a 
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word acab word acba heap a ■ c ■ a ■ b = a ■ c 


Figure 3: Two congruent words and the resulting heap 


3.2 — Length and Ordering 

The congruence X coincides with the reflexive and transitive closure of the immediate 
equivalence, which relates any two E-words of the form xaby and xbay, where x,y G Xt* 
and (a, b) € I. In particular, the length of congruent words is invariant, which defines 
a mapping | • | : AI —>■ N. For any heap x G M, the integer |x| is called the length 
of X. Obviously, the length is additive on AI: \x-y\ = \x\ + \y\ for all heaps x,y G M.. 
The left divisibility relation “<” is defined on AI by: 

'ix,y G M x<y 3z G M y = x ■ z. (5) 

It defines a partial ordering relation on M. H x < y, we say that a; is a sub-heap of y. 
Note that holds: x < y |a;| < |?/|. 

Visually, x < y means that a; is a heap that can be seen at the bottom of y. But, 
contrary to words, a given heap might for instance have several sub-heaps of length I. 
Indeed, in the example monoid T defined above, one has both a < a ■ b and b < a ■ b 
since a - b = b- a \nT. 

Heap monoids are known to be cancellative, meaning: 

Vx, y,u,u' G Ai X ■ u ■ y = X ■ u ■ y u = u . 

This implies in particular that, if x, y are heaps such that x < y holds, then the heap 
z in (5) is unique. We denote it by: z = y — x. 

3.3 — Cliques. Cartier-Foata Normal Form 

Recall that a clique of a graph is a sub-graph which is complete as a graph—this 
includes the empty graph. The independence pair (E, I) may be seen as a graph. 
The cliques of (E, I) are called the independence cliques, or simply the cliques of the 
heap monoid A4. 

Each clique 7 , with set of vertices {oi,..., a„} , identifies with the heap ai-.. .-an G 
A4 , which, by commutativity, is independent of the sequence (oi,..., an) enumerating 
the vertices of 7 . In the graphical representation of heaps, cliques correspond to 
horizontal layers of pieces. Note that any piece is by itself a clique of length I. We 
denote by the set of cliques of the heap monoid M, and by£ = ‘^\{ 0 } the set 
of non empty cliques. For the running example monoid T, there are 4 non empty 
cliques: £ = {a, b,c,a- b}. 

It is visually intuitive that heaps can be uniquely written as a succession of hori¬ 
zontal layers, hence of cliques. More precisely, define the relation —>■ on as follows: 

V 7 , 7 'g‘^ 7 7 ^ Vb G j 3a S 7 {a,b) ^ I. 

The relation 7 —>■ 7 ' means that 7 “supports” 7 ', in the sense that no piece of 7 ' 
can fall when piled upon 7 . 
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A sequence 71 ,..., 7 „ of cliques is said to be Cartier-Foata admissible if % —?► 7^+1 
holds for alii € — 1}. For every non empty heap x G Ai, there exists a 

unique integer n > 1 and a unique Cartier-Foata admissible sequence ( 71 ,... , 7 „) of 
non empty cliques such that x = 71 • ... • 7 „ . 

This unique sequence of cliques is called the Cartier-Foata normal form or de¬ 
composition of X (CF for short). The integer n is called the height of x, denoted by 
n = t{x). By convention, we set t(0) = 0. 

Fleaps are thus in one-to-one correspondence with finite paths in the graph (£, —>■) 
of non-empty cliques. By convention, let us extend any such finite path by infinitely 
many occurrences of the empty clique 0. Observe that 0 is an absorbing vertex of the 
graph of cliques —>■), since 0 —7 7 = 0 , and 7—^0 holds for every 7 G 

With this convention, heaps are now in one-to-one correspondence with infinite paths 
in ('^,—>■), that reach the 0 node—and then stay in it. 

3.4 — Infinite Heaps. Boundary 

We define an infinite heap as any infinite admissible sequence of cliques in the graph 
that does not reach the empty clique. The set of infinite heaps is called 
the boundary at infinity of M, or simply the boundary of M, and we denote it 
by dAi [1]. By contrast, elements of Ai might be called finite heaps. Extending the 
previous terminology, we still refer to the cliques 7 ^ such that f = (jn)n>i as to the 
CF decomposition of an infinite heap ^ . 

It is customary to introduce the following notation: 

M=M\JdM. 

Elements of M. are thus in one-to-one correspondence with infinite paths in 
those that reach 0 , correspond to heaps, and those that do not reach 0 , 
correspond to infinite heaps. For f G dM. , we put |^| = 00 . 

We wish to extend to Ai the order < previously defined on Ai. For this, we use 
the representation of heaps, either hnite or infinite, as infinite paths in the graph 
and we put, for ^ = ( 71 , 72 ,...) and £,' = ( 7 (, 7 ^,...): 

i<£.' Vn > 1 71 • ... • 7n < 7i ■ • ■ • ■ 7^ ■ ( 6 ) 

• Proposition 3.1 —The relation defined in ( 6 ) makes {Ai,<) a partial order, which 
extends (Ai, <), and with the following properties: 

1. {Ai,<) is complete with respect to: 

a) Least upper hounds (lub) of non-decreasing sequences: for every sequence 
(xn)n>i such that Xn G Ai and x„ < x„+i for all integers n> 1, the lub 
Vn>i exists in A4. 

b) Greatest lower bounds of arbitrary subsets. 

2. For every heap f G Ai, either finite or infinite, the following subset: 

LiO = {x G : X < a , (7) 

is a complete lattice with 0 and f as minimal and maximal elements. 

3. (Finiteness property of elements of Ai in the sense of [10]) For every finite 
heap X G Ai, and for every non-decreasing sequence (Xn)n>o of heaps, holds: 

\l Xn > X => 3n > 0 Xn > X. 

n >0 

4 . The elements of Ai form a basis of Ai in the sense of [10]; for all G Ai 
holds: 




(Vx G Ai C>x 


^ > x). 


3.5 — Elementary Cylinders. Bernoulli Measures 

For X € M a heap, the elementary cylinder of base x is the following non empty 
subset of dM'. 

fx = {£,&dM : X < C} ■ 

We equip the boundary dM with the cr-algebra: 

^ = a{f X , X € M ), 

generated by the countable collection of elementary cylinders. From now on, when 
referring to the boundary, we shall always mean the measurable space (dM,^). 

We say that a probability measure P on the boundary is a Bernoulli measure 
whenever it satisfies: 


yx,yeM F{t{x-y)) =F{fx)-¥{ty). (8) 

We shall furthermore impose the following condition to avoid degenerated cases: 

Vx € M P(ta:)>0. (9) 

If P is a Bernoulli measure on the boundary, the positive function f : M ^ M. 
defined by: 

Vx € M f{x) = P( t a;), 

is called the valuation associated to P. By definition of Bernoulli measures, / is 
multiplicative: /(x • y) = f{x) ■ f{y). In particular, the values of / on M are entirely 
determined by the finite collection {pa)ae^ of characteristic numbers of P defined by 
the value of / on single pieces: 


Va G E pa = f{a). (10) 

The condition (9) is equivalent to impose Pa > 0 for all a G E. 

For any heap x € M,F{f x) corresponds to the probability of seeing x at bottom 
of a random infinite heap with law P. By definition of Bernoulli measures, this 
probability is equal to the product Pa^ x • • • x pa„ , where the word ai.. . a„ is any 
representative word of the heap x. 

3.6 — Interpretation of the Introductory Probabilistic Protocol 

The sole definition of Bernoulli measures already allows us to interpret the probabilis¬ 
tic protocol introduced in § 2 by means of a Bernoulli measure P on the boundary of 
a heap monoid. Obviously, the heap monoid to consider coincides with our running 
example T = {a, h,c \ ah = ha) on three generators. Let us check that the measure 
P defined by the law of infinite heaps generated by the described protocol is indeed 
Bernoulli. 

Any heap x G T can be uniquely described under the form: 

X = (a’’^ ■ b‘^^) ■ c ■ ... ■ • 6'*'') • c • , 

for some integers k,ri, si,... ,rk+i, Sk+i > 0. For such a heap x, referring to the 
description of the probabilistic protocol, the associated cylinder f a: is described by: 


Round 1: 

II 

II 

Round k: 

II 

II 

Round fc -I- I: 

Na > rk+1, Nb > Sfe+i 
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and is given probability: 

P(t x) = (AA')'^'(l - A)’'i+ '+’'*^(l - AO'^+ '+'MI - A)’’''+i(l - A')""+^ . 

If / : Ad —>■ M is the multiplicative function defined by: 

/(«) = !-A, /(&) = !-A', /(c) = AA', (11) 

it is thus apparent that P(t x) = /(x) holds for all x € Ad. Since P(t x) is multi¬ 
plicative, the measure P is Bernoulli. 

In passing, we notice that, whatever the choices of A, A' € (0,1), the equation: 

1 - /(a) - f{b) - f{c) + f{a)f{b) = 0 

is satisfied, as one shall expect from (15)-(a) below. 

3.7 — Compatible Heaps 

In the sequel, we shall often use the following facts. We say that two heaps x, y € Ad 
are compatible if there exists z G Ad such that x < z and y < z. It follows in 
particular from Proposition 3.1 that the following propositions are equivalent: 

(i) X, y G Ad are compatible; 

(ii) t X n 12/ 0; 

(hi) the lub X V y exists in Ad. 

In this case, we also have: 


txnt 2 /=t(xVy), 

and if P is a Bernoulli probability measure on dM ., still for x and y compatible: 

P(tx| ty) =P(t((xVy)-y)) =P(t (x-(xAy))) . (12) 


3.8 — Mobius Transform. Markov Chain of Cliques 

Call valuation any positive and multiplicative function / : Ad —y R; the valuations 
induced by Bernoulli measures are particular examples of valuations. Any valuation 
is characterized by its values on single pieces, as in (10). 

If / : Ad —y R is any valuation, let h : R be defined by: 

VyG-r h(7)= ^ (_i)l7'H7l/(y). (13) 

: 7'>7 

The function h : R is the Mobius transform of /, a particular instance of the 

general notion of Mobius transform in the sense of Rota [15, 18]. For a given valuation 
/ : Ad —y R, there exists a Bernoulli measure on the boundary that induces / if and 
only the Mobius transform h of / satisfies the following two conditions: 


(a) h{0) = 0 ; 


(6) Vy G £ /i(y) > 0 . 


(14) 


Note that Condition (a) is a polynomial condition in the characteristic numbers, 
and Condition (b) corresponds to a finite series of polynomial inequalities. For in¬ 
stance, for the heap monoid T on tl 
obtain: 


(a) I- Pa- Pb- Pc+ PaPb = 0 , (6) < 


generators T = 

(a, b,c : ab = 

h{a) > 0 

Pa(l -pb) > 0 

h{b) > 0 ^ 

Pb(l -Pa) > 0 

/i(c) > 0 <;=^ 

Pc > 0 

^ h{ab) > 0 <;=^ 

PaPb > 0 


(15) 
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Returning to the study of a general heap monoid, and when considering the case 
where all coefficients Pa are equal, say to p, then both conditions in (14) reduce to 
the following: p is the (known to be unique [11, 12, 7]) root of smallest modulus of 
the Mobius polynomial of the heap monoid M, defined by: 

/r^,(X) = ^(-l)HxH. 

The associated Bernoulli measure is then called the uniform measure on the boundary. 

For the running example T, one has pp{X) = 1 — 3X + X^ , and the uniform 
measure is given by P(t a;) = P^^^ with p = (3 — •\/5)/2 . 

In the remaining of this subsection, we characterize the process of cliques that 
compose a random infinite heap under a Bernoulli measure. 

For each integer n > 1, the mapping which associates to an infinite heap f the 

clique 7 „ such that ^ = ( 71 , 72 ,...) is measurable, and defines thus a random 
variable Cn ■ dA4 —>■ £. Furthermore, the sequence (C„)„>i is a time homogeneous 
and ergodic Markov chain, of which: 

1. The initial distribution is given by the restriction h\^, where h is the Mobius 
transform defined in (13). 

2. For each non empty clique 7 G £, put: 

5 ( 7 )= 

7'GC : 7—>-7' 


Then the transition matrix P = (T’. 7 , 7 ')( 7 , 7 ')gc of chain is given by: 


P , — 


0 , if (7 — 7 ') does not hold, 

^( 70 / 5 ( 7 ), if (7 -5^ 7 ') holds. 


(17) 


In general, the initial measure /i|^ does not coincide with the stationary measure 
of the chain of cliques. 


4—Asynchronous Stopping Times 
and the Strong Bernoulli Property 

In this section we introduce asynchronous stopping times and their associated shift 
operators. They will be our basic tools to formulate and prove the Law of large 
numbers in the subsequent sections. 

4.1 — Definition and Examples 

Intuitively, an asynchronous stopping time is a way to select sub-heaps from infinite 
heaps, such that for each infinite heap one can decide at each “time instant” whether 
the sub-heap in question has already been reached or not. The formal definition 
follows. 

• Definition 4.1 —An asynchronous stopping time, or AST for short, is a mapping 
V : dM. —>■ Ai, which we sometimes denote by ; such that: 

T fvSf for all ^ € dM; 

2. e dM (l^vj < 00 A < f) Cv = ■ 

We say that V is P-a.s. finite whenever fyGM for P-a.s. every ^ € dM. 
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In the above definition, we think of as cut at F = 0 is a first, trivial 
example of AST. Actually, the property 2 of the above definition implies that if = 0 
for some ^ € dAA, then 1 / = 0 on dA4. Another simple example is the following. Let 
X £ A4 he a fixed heap. Define 14 : dA4 — A4 by: 

1 ^, otherwise. 

Then it is easy to see that 14 is an AST. We recover the previous example by setting 
a; = 0. 

Consider the sequence of random cliques {Ck)k>i associated with infinite heaps, 
and define for each integer k > 1 the random heap Yfe = Ci • ... • Cfe . Then, by 
construction, Yk < ^ holds; however, the mapping Yk is not an AST, except if A4 is 
the free monoid, which corresponds to the empty independence relation / on E. 

We will frequently use the following remark, which is a direct consequence of the 
definition: let V : dA4 —>■ AI be an AST, and let V be the set of finite values assumed 
by V. Then holds: 


Va: £ V {V = x}='[x. 


The following proposition provides less trivial examples of AST that we will use 
throughout the rest of the paper. Let us first introduce a new notation. If a £ S is a 
piece, and x £ M. is a heap, the number of occurrences of a in a representative word 
of x does not depend on the representative word, and is thus attached to the heap x. 
We denote it by |a;|a ■ 

• Proposition 4.2 —The two mappings dM M, ^ i—>■ ^y described below define 
asynchronous stopping times: 

1. For ^ = ( 71 , 72 ,. ■.), let = {fc > 1 : 7 fc is maximal in and put: 


iv = 


7 i • ... • 7 „ with n = min , if 7 ^ 0 , 


^, otherwise. 

2. Let a £ T, be some fixed piece. For ^ £ dAA, put: 

^v=/\Ha{0, Ha{f) = {x£LiOnM : |a:U > 0} , 


(18) 


(19) 


where L(ff) = {x £ A4 : x < ^} is the complete lattice defined in (7), and 
where the greatest lower bound defining ^y is taken in L{£f). It is called the first 
hitting time of a. 

For the first hitting time of a, since the greatest lower bound in (19) is taken in 
the complete lattice L{ff), if Haif) = 0 then ^y = maxL(^) = ^. 


Proof. 1. The condition ^y < is obvious on (18). Hence let £ dM such that 
fv^M and iv < f ■ We need to show that . For this, let ^ = ( 71 , 72 , ■ • ■) 

and = ( 7 ( 172 , • • ■), ^.nd let n = mini?^ and m = 71 • ... • 7 „ . By hypothesis, we 
have u < ^' and thus u < 7 ^ • ... • 7 ^^, by ( 6 ). 

It follows from [1, Lemma 8.1] that the sequences ( 7 i)i<i<n and ( 7 ()i<i<n are 
related as follows: for each integer i £ {!,... ,n}, there exists a clique 4 such that 
A 7 i = 0,..., A 7 „ = 0 , and 7 ' = 7 ^ • 4 • But 7 „ is maximal, therefore <5^ = 0 for 
alH £ {1,..., n}, and thus 7 ' = % . From 7 ^^ = 7 „ follows at once that min i?^/ < n. 
And since 7 ' = 71 for all i < n, no clique j' is maximal in otherwise it would 
contradict the definition of ^y . Hence finally min = n , from which follows ffy = 
I'l - - ■ 
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2. Again, it is obvious on (19) that Let G dM be such that ^ M 

and ^ C ■ Then Ha{^) ^ 0, and we observe that i^a(0 actually has a minimum, 
= min_ffa(^). This is best seen with the resource interpretation of heap monoids 
introduced in [6]. 

It follows that G Ha{C) and thus Ha{^') ^ 0. Henceforth, as above, we deduce 
iy = min Ha(^'), and < ^y ■ It follows that G Ha{^) and thus ^y < ^y and 
finally ^y = . □ 

4.2 — Action of the Monoid on its Boundary. Shift Operators 

In order to define the shift operator associated to an AST, we first describe the natural 
left action of a heap monoid on its boundary. 

For X € A4 and ^ G dA4 an infinite heap, the visually intuitive operation of piling 
up ^ upon X should yield an infinite heap. However, some pieces in the first layers 
of ^ might fall off and fill up empty slots in x. Hence the CF decomposition of x • ^ 
cannot be defined as the mere concatenation of the CF decompositions of x and 
The proper definition of the concatenation x • ^ is as follows. Let ^ = ( 71 , 72 , • ■ 
The sequence of heaps (x • 71 • ... • 7 n)ri>i is obviously non decreasing. According to 
point la of Proposition 3.1, we may thus consider: 

X • ^ = (x ■ ■ 7 n), which exists in dA4 , 

n>l 


and then we have: 


Vx, y £ M Vf G dM x ■ {y ■ ^) = {x ■ y) ■ ^. 

It is then routine to check that, for each x € M, the mapping: 

: dM -)■ t a;, 

is a bijection. Therefore, we extend the notation y — x, licit for x,y G M with x < y, 
by allowing y to range over dM, as follows: 

\/xGM V^Gta: ^ — X = <I'“^(^) . 

Hence C, = ^ — x denotes the tail of ^ “after” x, for ^ > x. It is characterized by 
the property x • C = C, and this allows us to introduce the following definition. 

• Definition 4.3— Let V : dM M he an AST. The shift operator associated to V 
is the mapping 6y : dM —> dM, which is partially defined by: 

y^GdM ^yGM=^ OyiO = ^-^V- 

The domain of definition of 9y is {|^v| < 00 } . 

4.3 — The Strong Bernoulli Property 

The Strong Bernoulli property has with respect to the definition of Bernoulli mea¬ 
sures, the same relationship than the Strong Markov property with respect to the mere 
definition of Markov chains. Its formulation is also similar (see for instance [14]). In 
particular, it involves a cr-algebra associated with an AST, defined as follows. 

• Definition 4.4 —Let V : dM M be an AST, and let V be the collection of finite 
values assumed by V. We define the a-algebra ^y as 

S'y = cr(t a: : x G V). 
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With the above definition, we have the following result. 

• Theorem 4.5 — (Strong Bernoulli Property) Let ¥ be a Bernoulli measure on dA4 , 
let V : dM M be an AST and let ip : DM —>■ K. 6e a ^-measurable function, either 
non negative or ¥-integrable. Extend ip o Oy , which is only defined on {|Cv| < c»}, 
by Ip o 9y = 0 on {|^v| = c»}. Then: 

E(^/; o dyjg'y) = E(^/;), P-a.s. on {|^v| < 00 } , (20) 

denoting by E(-) the expectation with respect to P, and by E(-|5^y) the conditional 
expectation with respect to P and to the a-algebra ^y . 

If V : dA4 —?► is P-a.s. finite, then the Strong Bernoully Property writes as: 

P-a.s. E{lp O 9y\^y) =E{ip). 

In the general case, we may still have an equality valid P-almost surely by mul¬ 
tiplying both members of (20) by the characteristic function l{vg^} , which is 5'y- 
measurable, as follows: 

P-a.s. E(l{vg^}V^ o 0y|g'y) = l|yg_^}E('0) . (21) 


Proof. It is enough to show the result for ip of the form ip = 1-^y for some heap 
y G M. For such a function ip, let Z = E{ip o 9y\^y). 

Let V be the set of finite values assumed by V. We note that the cylinders f ^; 
for X ranging over V, are pairwise disjoint since F(^) = a: on fa: for a: G V. Hence 
^y is atomic. Therefore, if Z : V —R denotes the function defined by: 


VxGV Z{x)=E{ipo9y\V = x), 


then a version of Z is given by: 


z{0 


0, ifF(e)=^, 

Z{x ), if F(5) = a: with x G M . 


For X G V and for ^ > x, one has 


ipo9v{C) =ip{^-x) = lty(^-a;) = l^(3,.y)(^). 

And since {V = x}=ta;forxGV, this yields: 

Z{x) =E{iPo9y\fx) = {x ■ y)) =¥{ty)=EiP, 

1P( J X) 

by the multiplicativity property of P. The proof is complete. □ 


5 —Iterating Asynchronous Stopping Times 

This section studies the iteration of asynchronous stopping times, defined in a very 
similar way as the iteration of classical stopping times for standard probabilistic pro¬ 
cesses; see for instance [14]. Properly dealing with iterated AST is a typical example 
of use of the Strong Bernoulli property, as in Proposition 5.3 below. 
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5.1 — Iterated Stopping Times 

• Proposition 5.1 —Let V : dM. Ai be an AST. Let Vq = 0, and define the 
mappings Vn ■ dAi Ai by induction as follows: 


yf G dAi K+i(0 


e, itVniO&dAi 

VniO-Vi^-Vr^iO) , iiVniO&M 


Then (Ki)n>o o, sequence of AST. 


Proof. The proof is by induction on the integer n > 0. 

The case n = 0 is trivial. Hence, for n > 1, and assuming that Vn-i is an AST, 
let G dAi be such that: 


Vr^iOSe- 

It implies in particular that G Ai and , from which follows by 

the induction hypothesis that Vn-i{f') = . Putting x = = Vn-i{0 

on the one hand, there are thus two infinite heaps C f' such that ^ = x ■ ( and 
^' = x-C,'. Putting y = V{^ — T„_i(^)) on the other hand, the assumption 14(^) < f' 
writes as: x ■ y < x ■ f, which implies y < by cancellativity of the monoid. But 
since V is an AST, this implies in turn H(4) = y, and finally, by definition of 14 : 

VniO = ^ • ViC) =X-y = Vn{f) . 

This shows that 14 is an AST, completing the induction. □ 

• Definition 5.2 —Let V : dAi Ai be an AST. The sequence (I4)n>o of AST de¬ 
fined as in Proposition 5.3 is called the iterated sequence of stopping times associated 
with V . 

• Proposition 5.3 —Let ¥ be a Bernoulli measure equipping the boundary dAi. Let 
(14)n>o be the iterated sequence of stopping times associated with an AST V : dAi —>■ 
Ai which we assume to be P-a.s. finite. Let also (A„)„>i be the sequence of incre¬ 
ments: 


Vn > 0 A„+i = V oOv^, 14+1 = 14 ■ A„+i. 

Then (A„)„>i is an i.i.d. sequence of random variables with values in Ai, with the 
same distribution as V. 

Proof. We hrst show that Vn € Ai for all integers n > 1 and P-almost surely. For 
this, we apply the Strong Bernoulli property (Theorem 4.5) with AST 14 -1 and with 
the function to get: 

P-a.s. = l{y„_ie7ci}E^ ■ 

But i and E4 = P(H G Ai) = 1 by hypothesis. Hence 

the equation above writes as: 

P-a.s. E(l{y„GA<}|5'y„_i) = ■ 

Taking the expectations of both members yields: P(I4 G Ai) = P(I4_i G Ai). 
Hence by induction, since P(Vb G Ai) = 1, we deduce that P(I4 G Ai) = 1 for all 
integers n > 1. 
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To complete the proof of the proposition, we show that for any non negative 
functions ,..., : M. —>■]&, holds: 

E((/9i(Ai) • ... • ipn{An)) = • ... • Eip„iV). (22) 

The case n = 0 is trivial. Assume the hypothesis true at rank n — 1 > 0. Applying 
the Strong Bernoulli property (Theorem 4.5) with the AST Vn-i yields, since 14,_i € 
Ai P-almost surely: 

P-a.s. E((^„(A„)|g'y„_J = E(/j„(y). (23) 

Let A be the left-hand member of (22). Since Ai,..., A„_i are -measurable, 
we compute as follows, using the standard properties of conditional expectation [3]: 

A = E(E(i^i(Ai) •... • i^„(A„)|5'y^_ J) 

= E(:^i(Ai) •... • (p„_i(A„_i) • E((^„(A„)|g'y^__ J) 

= E((/5 i(Ai) • ... • (/j„_i(A„_i)) • Eipn{V) by (23) 

= E^pi{V) • ... • Eipn{V) , 

the later equality by the induction hypothesis. This proves (22). □ 

5.2 — Exhaustive Asynchronous Stopping Times 

• Lemma 5.4 —Let V be an AST, that we assume to be P-a.s. finite. Let (V^)n>o be 
the associated sequence of iterated stopping times. Then the two following properties 
are equivalent: 

(i) ^ = Vn>0 ■ 

(a) ^ Vnif) for P-a.s. every ^ e dM. 

Proof, (i) implies (ii). By the Martingale convergence theorem [3, Th. 35.6], we have 
for every x € A4: 

P-a.s. lim E(l|a;|lJv„) = . (24) 

n—foo 

Let n > 0 be an integer, and let Vn denote the set of finite heaps assumed by Vn ■ 
Then, by the AST property of V„ , we have {Vn = y} = t y for every y € Vn , and 
thus, for every x G Ai compatible with y: 

P(ta:|K = y)=P(ta:| {y)=E{{{x-{xAy))) by (12) 

Therefore, by (24), we obtain for every x € Ai and for P-a.s. every Gf 2^' 

lim P(t (a: — (x A ^v„)) = 1- 

n—>-oo 

It implies that the sequence x A i which is eventually constant since it is non 
decreasing and bounded by x, eventually reaches x, since the only heap y € Ai 
satisfying P( f y) = 1 is y = 0. In other words: x < for n large enough. Hence: 

V„>o?Vn ^ ^ foi' every x € Ai and for P-a.s. every Gf In view of the basis 
property of Ai (point 4 of Proposition 3.1), it follows that Vn>o^H. = ^ holds P- 
almost surely. 

(ii) implies (i). Let be the cr-algebra: 

5' = V ■ 

n>l 
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To show that = S'', it is enough to show that t 2 ; G i?' for every x € M. But for 
X € M, by assumption Vra>i ^ ^ fo'' P-a.s. every ^ G f 2 :. By the finiteness 

property of elements of M. (point 3 of Proposition 3.1), it implies, for P-a.s. every 
^ Gf 2 :, the existence of an integer n > 0 such that 14(C) 4 x. Letting V denote the 
set of finite values assumed by any of the 14 , we have thus: 

\x= y 

v^V : v>x 

Since V is at most countable, it implies f 2 ^ G 5^', which was to be shown. □ 

• Definition 5.5— A P-a.s. finite AST that satisfies any of the properties (i)-(ii) of 
Lemma 5.4 is said to be exhaustive. 

5.3 — Examples of Exhaustive Asynchronous Stopping Times 

• Proposition 5.6 —Both examples V of AST defined in Proposition 4.2 are exhaus¬ 
tive, and satisfy furthermore ]E|14| < 00 . 

Proof. For both examples, that |14| < 00 P-a.s. and also that E|P| < 00 , follow from 
the two following facts: 

1. The Markov chain of cliques {Ck)k>i such that C = (41,42,...) is irreducible 
with a finite number of states (see § 3.8), and thus is positive recurrent. 

2. If a denotes the maximal size of a clique, then |Ci ■ ... ■ Ck\ < ak. 

We now show that both examples are exhaustive. Let (14)n>o be the associated 
sequence of iterated stopping times. 

For V defined in point 1 of Proposition 4-2. Since P < 00 P-a.s., it follows from 
Proposition 5.3 that 14 < 00 P-a.s. and for all integers n > 0. Let C = {ln)n>i 
be an infinite heap. Let n > 0 be an integer, and let ci Ck„ be the CF 

decomposition of 14(C)' Then, on the one hand, > n, and on the other hand, 
since Ck„ is maximal and since C 4 14(C)i it must hold: 


7 i = Cl, 72 = C 2 , ... 7fc„ = Cfe„ . 

Hence, if = {Yn)n>i denotes: 


c' = V ’ 

n>0 


one has 7 ' = 7 ^ for all i < kn and for all n > 0. And since > n, it implies 7 ^ = 7 ' 
for all integers i>l, and thus = C- This proves that V is exhaustive. 

For V defined in point 2 of Proposition 4.2. Let Y be the first hitting time of 
a G S. With the same notations as above, let us first show the following claim: 

(0) For every 6 G E: P(14 > 6 ) > 0. 

((>0) For every 5 G E, and P-almost surely: C 4 C^ 4 b. 

Proof of {(}). Since the dependence relation = (E x E) \ / is assumed to 
make the graph (E, D) connected, we pick a sequence oi,..., a^ of pairwise distinct 
pieces such that ai = b, Oj = a and (ai,ai+i) G D for all i G — 1} . 

Put X = ai ■ ... ■ Oj . Then it is clear that 14(C) = x for every C 4 2 . Hence 

P(14 = a;) = P( t 2 ) > 0. Since 6 < x, it follows that P(14 > 6) > P( f x) > 0. 

Proof of (00). Let (A„)„>i be the sequence of increments, such that 14-i-i = 14- 

A„_|_i . Then (A„)„>i being i.i.d. with the same law as V according to Proposition 5.3, 
and since P(14 > 5) > 0, it follows from Borel-Cantelli Lemma that there exists at 
least an integer n > 1 such that A„ > b, for P-a.s. every C G dA4. For P-a.s. every 
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? > b, let n be the smallest such integer. Then the heap Ai • ... • A„_i does not 
contain any occurrence of b on the one hand, and is compatible with b on the other 
hand. That implies that b commutes with all pieces of Ai • ... • A„_i. Therefore, it 
follows that 5 < Ai • ... • A„ < . The claim (00) is proved. 

Now, to prove that V is exhaustive, let a; € be a heap. We show that, P-a.s., 
^ > X => > X, which will complete the proof via the basis property of Ai (point 4 

of Proposition 3.1). Putting y = ^' A x, and assuming ^ > x, we prove that y = x 
holds P-almost surely. Assume y ^ x. Since y < x, there is thus a piece 6 G S such 
that y ■ b < X holds and (^' — y) > b does not hold. Let N be the smallest integer 
such that Vn{^) A X = y; such an integer exists, by the finiteness property of dAi 
(point 3 of Proposition 3.1). Let z = Vn{0- Then it follows from the definition of 
the sequence (T4)ra>o that holds: 

Vn>iV Vn{0 = ^-VN-n{i-z). 

According to the property (00), for P-a.s. every ^ such that ^ — z > b, there 
exists an integer fc > 0 such that 14(^ — z) > b. But then, V^+kiO ^ U ' b, and thus 
A X > y ■ b, contradicting the definition of y. It follows that y ^ x can only occur 
with probability 0, which was to be proved. □ 


6—The Cut-Invariant Law of Large Numbers 


6.1 — Statement of the Law of Large Numbers 

We first define ergodic sums and ergodic means associated with an AST and with a 
cost function. The setting of the section is the same as previously: a heap monoid 
Ai = AI(S,/) together with a Bernoulli measure P on {dAi,^). 

If : E —> K is a function, seen as a cost function, it is clear that ip has a unique 
extension on Ai which is additive; we denote this extension by {ip, •). Hence, if the 
E-word xi... Xn is a representative of a heap x, then: 

{ip, X) = ip{Xi) -I- ... -I- ip{Xn) ■ 

In particular, if I denotes the constant function, equal to I on E, one has: (1, x) = 
|a;| for every x G Ai. 

• Definition 6.1— Let V : dAi -A Ai be an AST, which we assume to be P-a.s. 
finite, and let ip : H ^ be a cost function. Consider the sequence of iterated 
stopping times (14)n>o associated with V. The ergodic sums associated with V are 
the random variables in the sequence {Sv,nT)n>o defined P-o.s. by: 

Vn > 0 Sv,nT = {t^ ■ 


The ergodic means associated with V are the random variables in the sequence 
{Mv,n)n>i defined P-a.s. by: 


Vn > 0 


Mv,nT 


Sv,nT 

Sv,ni 




• Theorem 6.2 —Let AI(E,/) be a trace monoid, equipped with a Bernoulli measure 
P on {dAi,S) and with a cost function (/? : E —> K. 

Then, for every exhaustive asynchronous stopping time V : dAi -A Ai such that 
E|H| < oo holds, the ergodic means {Mv,n)n>i converge P-a.s. toward a constant. 
Furthermore, this constant does not depend on the choice of the exhaustive AST V 
such that E|14| < oo. 
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Before we proceed with the proof of Theorem 6.2, we state a corollary which 
provides a practical way of computing the limit of ergodic means. 

• Corollary 6.3 —Let : S — ^ R 6e a cost function. Let tt be the invariant measure of 
the Markov chain of cliques associated with a Bernoulli measure P on DM.. Then the 
limitMtp of the ergodic means My,nT > fof o,ny exhaustive AST V such thatEi\V\ < oo 
holds, is given by: 

Mip = 

7eC 7G£ 

Proof. According to Theorem 6.2, to compute the value Mip, we may choose any AST 
of finite length in average. According to Proposition 4.2, the AST V : dM. —>■ A4 
defined in point 1 of Proposition 4.2 is eligible. But then the ergodic means are given 
by: 


Mv,nT 


Kn ) + ...+ V^(C'iC„ ) 

\Ci\ +... + \CkA 


where {Ck)k>i is the Markov chain of cliques associated with infinite heaps, and for 
some integers such that lim^^oo Kn = oo. The equality (25) follows then from 
the Law of large numbers [5] for the ergodic Markov chain {Ck)k>i ■ □ 


6.2 — Direct Computation for the Introductory Probabilistic Protocol 

We have computed in § 2 the asymptotic density of pieces for the heap monoid 
T = {a, b, c \ ab = ba) by computing ergodic means associated either with the first 
hitting time of c or with the first hitting time of a. The fact that the results coincide 
can be seen as an instance of Theorem 6.2. Corollary 6.3 provides a direct way of 
computing the limit density vector, without having to describe an infinite set of heaps 
as we did in § 2 , which would become much less tractable for a general heap monoid. 
Let us check that we recover the same values for the density vector 7 = {ja 7 b 7 c) . 

We have already obtained in (11) the values of the characteristic numbers of the 
associated Bernoulli measure: /(a) = 1 — A, f{b) = 1 — A', /(c) = AA'. Let us use the 
short notations a, b, c for /(a), f{b), f{c). The Mobius transform is then the following 
vector, indexed by cliques a, b, c, ab in this order: 

h = (a(l — b) 6(1 — a) c a 6 ) 

Using the equality 1 — a — 6 — c + a 6 = 0, and according to the results recalled 
in § 3.8, the transition matrix of the chain of cliques is given by: 


/ a 

0 

Th 0^ 


( 1-A 

0 

A 


0 

6 

0 


0 

1-A' 

A' 

0 

a(l — 6) 

6(1 — a) 

c ab 


A'(l-A) 

A(l-A') 

AA' 

(1-A)(1-A') 

Va(l - 6) 

6(1 — a) 

c ab/ 



A(1 - A') 

AA' 

(1-A)(l-A')y 


Direct computations give the left invariant probability vector tt of P: 


TTb 

1 

7^ 

1 1 

to to 

TTc 

A2 + A'2-AA'(A + A'-1) 

AA'(A + A'-AA') 

yTTab/ 


^AA'(1-A)(1-A'); 
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Using the notion of limit for ergodic means, the density vector defined in § 2 is 
7 = (la lb 7c) = M^{b} , which yields, according to the result 

of Corollary 6.3: 



1 



1 


+ TTb + TTc + ‘2tT ab 

As expected, we recover the values found in § 2 . 


A + A' - AA' 


^A'(l-A)' 
A(l-A') 
AA' 


6.3 — Proof of Theorem 6.2 

The proof is divided into two parts, each one gathered in a subsection: first, the proof 
of convergence of the ergodic means (§ 6.3.1); and second, the proof that the limit 
does not depend on the choice of the AST V : dM —>■ M, provided that E|U| < oo 
holds (§ 6.3.2). 

6.3.1 Convergence of Ergodic Means — Using the notations introduced in Theo¬ 
rem 6.2, let (A„)„>i be the sequence of increments associated with the sequence (Vn)n>i 
The increments are defined as in Proposition 5.3. Then we have: 

^ ...■ An) __ n _ (y?, Ai) ... -F (yj, A„) 

(UAi-.... A„) (l,Ai) + ... + (l,A„) ■ n 

Let M = max \ip\ . Then the assumption | < oo implies: 

]E|(:p,Cv)| < ME\^v\ < oo . 


Since (A„)„>i is i.i.d. according to Proposition 5.3, each A^ being distributed 
according to ^v, the Strong law of large numbers for i.i.d. sequences implies the P-a.s. 
convergence: 


lim 

n—¥oo 


(Ti ^l) + ■ ■ ■ + ^n) 

n 




lim 

n—^oo 


(1; ^l) -I- ... -I- (1, A„) 

n 


E|ey|. 

(26) 


It follows in particular from V being exhaustive that E|^y| > 0; otherwise, we 
would have = 0, P-a.s., and thus = 0, P-a.s. and for all n > 0, contradicting 
the P-a.s. equality Vn>o'^^n = C stated in Lemma 5.4. Hence, from (26), we deduce 
the P-a.s. convergence: 


lim Mv,nf 


El^yl 


6.3.2 Uniqueness of the Limit — We start with a couple of lemmas. 

• Lemma 6.4 —Let f : Ai ^ M. be the valuation defined by f{x) = P(t a;) for all 
X G M, and let B = be the non-negative matrix defined by: 


V(7,7') G £ X £ 





if -(7 7 '), 

if 7 — 7 '. 


Then B has spectral radius 1. 


Proof. Let || • || denote the spectral radius of a non-negative matrix, that is to say, 
the greatest modulus of its eigenvalues. 
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We observe first that S is a primitive non negative matrix (see [17]). Indeed, it is 
irreducible since the graph of non empty cliques (£,—>■) is strongly connected on the 
one hand, according to [12, Lemma 3.2], and since / is positive on the other hand. 
And it is aperiodic since c —^ c holds for any clique c G £. 

Let h : ^ R be the Mobius transform defined in (13), and let g = (g( 7 )).yg(r 

be the normalization vector defined in (16). The following identity is proved in [1, 
Prop. 10.3] to hold for all 7 £ £: h{'y) = f{'y)g{j) ■ It implies: 

(^ 5)7 = ^(' 7 ') = 9{l) ■ 

: 7—>-7' 7'€G!' : 7—^7' 

Hence g is H-invariant on the right. Since h > 0 on £, the vector g is positive, 
and thus ||il|| > 1 . 

We now prove the converse inequality. For every e £ (0,1), we consider the valua¬ 
tion /e : —>• R defined by fe{x) = and the matrix = (( 7 l£) 7 , 7 ')( 7 , 7 ')eCx£ 

defined by: 

= l{7->7'}/e(7 ) j 

and we claim that holds: IlHgH < 1 . 

For proving this, let / = and be the vectors defined by 

1^ = 1 and {Fs)-y = fe{l) for all 7 £ £. Denoting by /' the transpose of /, and 
recalling that r(-) denotes the height of heaps, we have: 

Vfc>0 I'B^,F,= Y. 

: 

T{x) — k-\-l 

I'i^B':)F,= Y (27) 

fc>0 aiGA<\{0} 

Let us show that the right member in (27) is a convergent series. Let w £ A1 be 
a heap with the following property: 

Vi, y € M \x\ = \y\ Ax ^ y => f ( 2 ^ • w) H '[ {y ■ w) = ^. (28) 

Such a heap exists according to the Hat Lemma [1, Lemma 11.2]. Since P is a 
probability measure, we have, for every integer n > 0 : 

P( y t (a:-w)) < 1 

x^Ai : |x|=n 

^ P(t(i-H)<i 

x^Ai : \x\—n 

/(^)( H /(a;)) < 1 

x^AA. : |a:|=n 

It follows that there exists a constant M > 0 such that: 

Vn > 0 Y^ /(a^) < M < 00 

x^Ai : |ai|=n 


by (28) 

since / is multiplicative 


It implies: 

XI ■^s(®) = X /(a;)) < A7(X^”) < 

x^Ai n>0 x€A4 : |ai|=n n>0 
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showing that the series in the right member of (27) is convergent. 

Now the same argument as for B applies: is primitive. Henceforth, from (27), 

we deduce that ||i?e|| < 1 , as claimed. 

Passing to the limit when e —>■ 1“ , we obtain ||i?|| < 1. This concludes the proof 
of the lemma. □ 


• Lemma 6.5 —Let a G Ti be a piece, and let j\4'^ be the sub-monoid of M consisting 
of heaps with no occurrence of a. Then: 

P(ta;)<oo, |x| P(t a:) < oo , |a;p P( f a:) < oo . 

xGAi'a xGA4'^ xGM'^ 


Proof. We still denote as above by || • || the spectral radius of a non-negative matrix. 
Let B the matrix defined as in Lemma 6.4, and let Ba be the matrix obtained by 
replacing in B all entries ( 7 , 7 ') by 0 as long as 7 or 7 ' contains an occurrence of a. 
Then the non-negative matrices B and Ba satisfy Ba < B and Ba ^ B. Since B 
is primitive, and since ||i?|| = 1 by Lemma 6.4, it follows from Perron-Frobenius 
theory [17, Chapter 1] that ||i?a|| < 1- The result follows. □ 


• Lemma 6 . 6 —Let a G T, be a piece. Let V be the first hitting time of a, and let 
iVk)k>o be the associated sequence of iterated stopping times. Fix x ^ 0 a heap, and 
let Jx : dM. —>■ N U { 00 } be the random variable defined by: 

Jxif) = inf{fc >0 : Vfc(^) > x} . 


Then the random variable Ux ■ dM —^ M defined by: 

77 ifT;r( 0 <oo, 

^ U, ifj.(0 = oo, 

is an AST, and there exists a constant C > 0, independent of x, such that: 

]E((|C/x|-|:r|)' I tx) <C. 


(29) 


Proof. The fact that Ux is an AST is an easy consequence of the 14’s being AST 
(Proposition 5.1). Since V is exhaustive by Proposition 5.6, in particular Jxif,) < 00 
for P-a.s. every ^ G f 2 :. Henceforth, the conditional expectation in (29) is computed 
as the following sum: 


E((|C^x|-|a:|)" I ta:) 


y] (|y| - \x\fV{{Ux = y}r^fx), 


where Ux denotes the set of finite values assumed by Ux ■ Since Ux is an AST, we 
have for all y gUx ■ 


{Ux = y} =ty, 

^ -F{{Ux = y}ntx) = 1 = P( t (?/ - x)) , 


P(ta;) ^ p(ta:) 

the later equality since x < y and by the multiplicativity property of P. Therefore: 

m\Ux\-\x\)^ I ta:) = y] \y - x\^F{t {y - x)) (30) 

yGUrc 
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Recall that each heap can be seen itself as a partially ordered labelled set [21], 
where elements are labelled by E. Assume first that x contains a unique maximal 
piece, say 6 € S. Such a heap is called pyramidal. Then for each y £ lAx , the heap 
z = y — X has the following shape, for some integer fc>0: z = Si ■ ■ 5k-i ■ Sk , 

where the (i^’s for i G 1} result from the action of the hitting time V prior 

to Vfc > X. In particular, the k — 1 first heaps Si do not have any occurrence of 6; 
whereas Sk writes as = u ■ a for some heap u with no occurrence of a. Denoting 
by and respectively the sub-monoids of M of heaps with no occurrence of a 
and of b, we have thus z = v ■ u ■ a, for some v G Al], and u G ■ Hence, from (30), 
we deduce: 

m\Ux\-\x\f I tec) < ^ (|n| + |z;| + l)2p(tn)-P(t^e)-P(ta). 

veM'i, 

Since a and b range over a finite set, it follows from Lemma 6.5 that the sum 
above in the right member is bounded by a constant. The result (29) follows . 

We have proved the result if x is pyramidal. The general case follows since every 
heap X writes as an upper bound a; = a;i V ... V of at most a pyramidal heaps, 
with a the maximal size of cliques. □ 

• Lemma 6.7— Let W be an AST such that E|1T| < oo. Let a G T, be a piece. Let 
V be the first hitting time of a, and let {Vk)k>o be the associated sequence of iterated 
stopping times. Let K : dM. —> N U {oo} be the random integer defined by: 

K{0=mf{k>0 : Rfc(0>fA(e)}- 

Then the mapping U : dM —>■ M defined by: 

jy^ f (C), if A:(0 < oo, 

ffK{£,)=oo 

is an AST, and there is a constant C > 0 such that: 

m\u\-\w\f)<c. 

Proof. Let W denote the set of finite values assumed by W. Since E|1T| < oo, in 
particular W < oo P-almost surely, and therefore: 

E{{\U\-\W\f) = P(t«^)E((|C/|-H)" I 

= ^ P(t ^c)]E((|17u;| — |w|)^ I t w) with the notation Ux of Lemma 6.6 

< P(t u))C with the constant C from Lemma 6.6 

< c 

The latter inequality follows from the fact that the elementary cylinders f "cc, for w 
ranging over W, are pairwise disjoint since W takes different values on different such 
cylinders. The proof of Lemma 6.7 is complete. □ 

Finally, we will use the following elementary analytic result. 
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• Lemma 6.8 —Let {Xk)k>i be a sequence of real random variables defined on some 
common probability space P), and such that EjXfep < C < oo for some con¬ 

stant C. Then limfc_).oo Xk/k = 0 holds F-almost surely. 

Proof. Let Yk = Xk/k. To prove the P-a.s. limit Yk —>■ 0, we use the following well 
known sufficient criterion: 

Ve>0 ^P(|Ffc| > e) < oo. 

fc>l 

Applying Markov inequality yields: 

^ P{\Yk\ > e) = E ^ E § < ’ 

fc>l k>l k>l 

which shows the result. □ 


We now proceed with the proof of uniqueness of the limit in Theorem 6.2. The 
setting is the following. Let W be an exhaustive AST such that E|W| < oo, let 
{Wn)n>o be the associated sequence of iterated stopping times. By the first part of 
the proof (§ 6.3.1), we know that the ergodic means Mw,nT converge P-a.s. toward a 
constant, say M{W,ip). 

Pick a S S a piece, and let V be the first hitting time of a. Let {Vn)n>o be the 
associated sequence of iterated stopping times, and let M{V,(p) be the limit of the 
associated ergodic means My^nP ■ We shall prove that MfW, (p) = M{V, ip). This will 
conclude the proof of Theorem 6.2. 

We consider for each integer j > 0 the following random integer Kj : dXi —?> 
N U {oo}: 

if,(e)=inf{fc>0 : Vk{f)>W,{0). 
and the AST V' : dM —>■ M dehned by: 




ifi^j<oo, 
f , \i Kj = oo . 


Since Wj < V/ by construction, we put Aj = V/ — Wj , so that V/ = Wj ■ Aj . 
Then, by Lemma 6.7, there is a constant C > 0 such that: 

Vj>0 E|Ajf<C. 

Hence, applying Lemma 6.8 with Xj = |Aj|, and since \{p,Aj )l < M\Afi if 
M = max{|(/j(x)| : a; G E} , we have: 


-a.s. lim 


= 0 , 


P-a.s. lim 




= 0 . 


J^OO J 

We also have, according to the result of § 6.3.1: 


J^OD J 


P-a.s. lim 


I _ irlwl ^ n Tp_a,s_ lim 


= E|W| > 0, 


J j->-oo \Wj\ 

The ergodic means can be compared as follows: 

{p,W,) + {p,A,) {p,W,) 


Mypjp — My/jP = 


\Wfi + \Afi |W,| 


m + \A, 


|W{,-| + |A,| \Wfi 


(31) 


= M{W, p). (32) 
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Using (31) (32), both terms in the right member above go to 0, and therefore: M{V', (f) = 

But, since limj_).oo Kj = oo, we clearly have M{V', ip) = M{V, p), and thus finally: 
M{W, p) = M(U, p)^ which was to be shown. The proof of Theorem 6.2 is complete. 

7—A Cut-Invariant Law of Large Numbers 
for Sub-Additive Functions 

In § 6, we have obtained a Strong law of large numbers relative to functions of the 
kind {p, •) : > R, which are additive by construction—and any additive function 

on A1 is of this form. 

Interesting asymptotic quantities however are not always of this form. For in¬ 
stance, the ratio between the length and the height of heaps, |x|/t(x) , has been 
introduced in [12, 16] as a measure of the speedup in the execution of asynchronous 
processes. 

The height function is sub-additive on M: t{x ■ y) < t{x) + T{y). This con¬ 
stitutes a motivation for extending the Strong law of large numbers to sub-additive 
functions. We shall return to the computation of the speedup in § 7.2, after hav¬ 
ing established a convergence result for ergodic ratios with respect to sub-additive 
functions (Theorem 7.1). 

7.1 — Statement of the Law of Large Numbers for Sub-Additive Functions 

As for additive functions, we face the following issues: (1) Define proper ergodic ratios 
with respect to a given AST ; (2) Prove the almost sure convergence of these ratios; 
(3) Study the uniqueness of the limit when the AST varies. 

We restrict the proof of uniqueness to first hitting times only. 

• Theorem 7.1 —Let a heap monoid M = be equipped with a Bernoulli 

measure P, and let p : M be a sub-additive function, that is to say, p satisfies 

S: T{^)Tp{y) for all x,y € M . We assume furthermore that p is non-negative 

on M . 

Let a € T, be a piece of the monoid, and let (14i)n>o be the sequence of iterated 
stopping times associated with the first hitting time of a. Then the ratios pfVn)l\yn\ 
converge P-a.s. as n ^ oo, toward a constant which is independent of the chosen 
piece a. 

We gather into two separate subsections the proof of convergence (§ 7.1.1), and 
the proof that the limit is independent of the chosen piece (§ 7.1.2). 

7.1.1 Proof of Convergence — The proof is based on Kingman sub-additive Ergodic 
Theorem, of which we shall use the following formulation [19]: let (D,5^, P) be a 
probability space, let T : D —>■ 12 be a measure preserving and ergodic transformation, 
and let {gn)n>i be a sequence of integrable real-valued functions satisfying gn+m < 
gn + PmO A” for all integers n,m> 1. Then gnjn converge P-a.s. toward a constant 
g > -oo. 

• Lemma 7.2 — If V : dM. M is an exhaustive AST, then the shift operator Qy : 
dM. —>■ dAA which is P-a.s. defined on dM, is measure preserving and ergodic. 

Proof. To prove that Oy is P-invariant, it is enough to show P(0y^ (t 2 :)) = P( t a:) for 
all heaps x € M. Let x G M. The equality ^ = f,v ■ &y{f,) holds P-a.s. since U < 00 
P-almost surely. Therefore, denoting by V the set of finite values assumed by V, one 
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has: 


P-a.s. 0y^(ta:)=[J t ‘ a:) • 

t;GV 

The cylinders f ^ i for w ranging over V, are pairwise disjoint, since V assumes 
distinct values on each of them. Hence, passing to the probabilities and using the 
Bernoulli property: 

IP(^y^(ta;)) =lP(ta:)P(|H| < oo) =P(ta;). 

vev 

This proves that 0y is P-invariant. 

We now show the ergodicity of Oy ■ Let / : dA4 —>■ K be a bounded measurable 
and 0y-invariant function. Since V is exhaustive, S = Vn>i Ly Lemma 5.4. 
Hence, by the Martingale convergence theorem [3, Th. 35.6]: 

/= lim E(/|j?y„) P-a.s. (33) 

n—>‘00 

Since Vn € A4 with probability 1, the Strong Bernoulli property (Theorem 4.5) 
implies: 

E(fodyJSvJ=m) P-a.s. 

But, since / is assumed to be 0y-invariant, and noting that 0y^ = (Oy)^ by construc¬ 
tion, the above writes as: E(/|5^y„) = E(/), which yields / = E(/) by (33), proving 
the ergodicity of dy . □ 

We now prove the following result, which is slightly strongest than the convergence 
part in the statement of Theorem 7.1: 

(t) For every exhaustive AST V : dAi Ai, if {Vn)n>i is the sequence of iterated 
stopping times associated with V, the sequence </j(14,)/|W| is P-a.s. convergent, 
toward a constant. 

Since, by Proposition 5.6, first hitting times are exhaustive, this statement implies 
indeed the convergence statement in Theorem 7.1. 

For the proof of (f), let = ^p{Vn) for n > 0. An easy induction shows that for 
any integers n, m > 0, one has: 

= K • (Kn oOyJ, 9y„ = {OvT , 

and thus by sub-additivity of ip: gn+m < Qn + dm ° (^*v)” . 

The application of Kingman sub-additive Ergodic Theorem recalled above is per¬ 
mitted by the measure-preserving property and the ergodicity of 6y proved in Lemma 7.2. 
It implies the P-a.s. convergence of gn/n = (p(Vn)ln toward a constant. Since 
lim„_>oo \ Vn\/n = E|F| with probability 1 by Theorem 6.2, we deduce the P-a.s. 
convergence of the ratios ip{Vn)/\Vn\ as n —?► oo toward a constant, which proves (f). 

7.1.2 Proof of Uniqueness — To complete the proof of Theorem 7.1, it remains only 
to show that the limit of the ratios V^(Fri)/|I4,| is independent of the AST V, that is 
to say, of the piece for which V is the first hitting time. For this, we first show the 
following result: 

(I) Let ip : A4 be a sub-additive and non-negative function. Let W : dAi —>■ Ai 
be an AST such that E|H7| < oo, let (IF„)„>o be the associated sequence of 
iterated stopping times, and let MW be the P-a.s. limit of p{Wn)/\Wn\ ■ Let also 
V he the first hitting time of some piece a, let (W)n>o be the associated sequence 
of iterated stopping times, and let MV be the P-a.s. limit of p{Vn)/\Vn\ ■ Then 
MV<MW. 
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For the proof of (|), we follow the same line of proof as for the uniqueness in the 
proof of Theorem 6.2 (§ 6.3.2). Using the very same notations for and A„, we 
have = Wn ■ A„ , and thus: 

_ ^{Wn) _ ^{Wn ' ^n) - ^{Wn) _ |A„|y)(VF„) 

IK)I IW^nl “ |W„| + |A„| |W„|(|1U„| + |A„|) 

^ ^ ^ ^ ^ 

An Bn 


The sub-additivity of ip and the existence of the CF decomposition of heaps shows 
that ip{x) < CiX for all a; G and for some real constant Ci . Therefore, using 
again the sub-additivity of ip, we obtain: 

An < Cl , and thus: limsup < 0. 

|W„| + |A„| „^oo 

The ratios ip{Wn)/\Wn\ being bounded since they have a finite limit, it is clear 
that the terms Bn converge to 0. We deduce: 


lim sup 

n—yoo 



'^{Wn) \ 
\Wn\ J 


< 0 . 


But the ratios :/5(Ui)/11^1 also have a limit, and clearly lim:/7(TU)/|tA| = \m\p{Vn)/\Vn\ ■ 
Hence we obtain: 


lim 



< 


lim 


^{Wn) 

\Wn\ 


which proves (|). 

It is now clear that if both V and W are first hitting times, then MV = MW 
since MV < MW and MW < MV by applying (|) twice. This completes the proof 
of Theorem 7.1. 

7.2 — Computing the Speedup 

Let us define the speedup of the pair {Mi , P), where P is a Bernoulli measure on the 
boundary dMi of a heap monoid Mi, as the P-a.s. limit of the inverse of the ergodic 
ratios: 


-a.s. p = lim 


IK I 

^(K) 


where V is the first hitting time associated with some piece of the monoid. The 
greater the speedup, the more the parallelism is exploited. 

Based on generating series techniques, the authors of [12] obtain an expression 
for a similar quantity for the particular case of uniform measures. With Bernoulli 
measure, we obtain a more intuitive formula, easier to manipulate for algorithmic 
approximation purposes. 

• Proposition 7.3 —The speedup is given by: 


cG£ 


(34) 


where tt is the invariant measure of the Markov chain of cliques under the probability 
measure P. 
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Proof. Let W be the AST defined in point 1 of Proposition 4.2. Then W is exhaustive 
and satisfies E|VP| < oo according to Proposition 5.6. Let (VP„)n>o be the associated 
sequence of iterated stopping times. Then, since the height r(-) is sub-additive, 
it follows from (f) in § 7.1.1 that the ratios T{Wn)/\Wn\ converge P-a.s. toward a 
constant, say MW. Furthermore, according to (|) in § 7.1.2, p~^ < MW. Hence, to 
complete the proof of the proposition, it is enough to show the following two points: 

1. MW = (E-yga;7r(7)|7|)"^ . 

2. MW < p-^ . 

Proof of point 1. For f G dM an infinite heap given by ^ = ( 7 i)i>i , let G A4 
be defined for each integer n > 0 by = 71 • ... • 7 „ . For each integer n > 0, there 
is an integer such that Wn = i lim„_>oo Kn = 00 . Therefore: 


MW = lim 

n—^oo 


t{Yk„) 


(35) 


But we have t(Yj ) = j for each integer j > 1. Therefore, applying the Strong law 
of large numbers [5] to the ergodic Markov chain (C'„)„>i, we get: 


T{Yj) ^ J_ 

l>S-| 


_ i _ 

ICil -I--I- \Cj\ 


■ 3^00 (Xl^(7)l7l) 

7^^ 


(36) 


Point 1 results from (35) and (36). 

Proof of point 2. For each integer n> 0, let r„ = T{Vn) ■ Then the heap Fm has 
same height as 14,, and has no lesser length. Therefore the ratios satisfy: 

T(YrJ ^ t(14) ^ r(14) 

l>;j l>VJ ■ IKI ■ 


Passing to the limit, we obtain MW < p ^, completing the proof. 


□ 


For the example monoid T = (a,b,c \ ab = ba) equipped with the uniform measure 
P given by P(t a:) = with p = (3 — \/b)l2, the computation goes as follows. 
Referring to the computations already performed in § 6.2, the invariant measure tt is: 


2p+l 


/ P 
P 

—3p -f 2 

V 3p-l 


a 

b 


c 

ab 


According to Proposition 7.3, the speedup is: 


P — TTa -f TTft -|- TTc -|- ^TTab 


5p 

2p+l 


5(7-75) 
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1.0827 - •• 


Our method allows for robust algorithmic approximation of the speedup, through 
the following steps: 1. Approximating the root of the Mdbius polynomial; 2. Deter¬ 
mining the invariant measure of the matrix (17); 3. Computing the speedup through 
formula (34). 
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